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(57) The present invention provides a method for 
predicting move compensation for predicting 
move compensation of an input image based on 
a move vector of the input image from this input 
image to a reference image which has been 
sampled at a first set time, and the method 
includes a unit for calculating a move vector of 
the input image based on a move, at a second 
set time, of a block unit which is a part of the 
input image and consists of a plurality of pixels, 
and a unit for calculating a move vector of the 
reference image based on a move, at the first 
set time, of a block unit which is a part of the 
reference image and consists of a plurality of 
pixels. Move compensation of the input image 
is calculated both from the move vector of this 
input image and from the move vector of the 
reference image, to thereby realize a method for 
predicting move compensation with high pre- 
cision. 
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BACKGROUND OF THE INVENTION 

FIELD OF THE INVENTION 

The present invention relates to a method for pre- 5 
dieting move compensation of a dynamic image to be 
utilized in an apparatus which requires a prediction of 
a dynamic image such as an image transmission and 
an image compression. 

10 

DESCRIPTION OF THE PRIOR ART 

With the progress of the semiconductor technol- 
ogies, methods for predicting move compensation to 
be utilized for a transmission of an image and a com- 15 
pression of an image have been widely used in many 
fields in the recent years. Among such conventional 
methods for compensating a move of a dynamic im- 
age, there is one method for compensating a move of 
a dynamic image based on one piece of reference im- 20 
age. 

Fig. 6 is a diagram for showing the concept of the 
conventional method for compensating a move of an 
image. Referring to Fig. 6, a dynamic image signal is 
a set of image which are sampled with an equal time 25 
interval tO on the time axis. For example, an NTSC 
signal has images sampled at every 1/60 second for 
each field and a PAL signal has images sampled at 
every 1/50 second for each field. When a certain ob- 
ject of which images are to be picked up is moving, for 30 
example, the spatial position of an object A in an M- 
th image has deviated from the spatial position of an 
object A' in an (M-1)-th image by a portion of a move 
of the object during a period of tO. Now, consider a 
case for predicting the M-th image from the (M-1)-th 35 
image. In order to make a prediction of the M-th im- 
age with a high level of precision by compensating a 
move of the object from an input image to a reference 
image during a time difference of tO, the M-th image 
is divided into blocks including at least one pixel, and 40 
a move of each block from the (M-1)-th image to the 
M-th image is detected so that a pixel value of the im- 
age at a position deviated by the portion of this move 
is set as a predicted value. This will be explained with 
reference to Fig. 6. To obtain a predicted value of a 45 
pixel X of the M-th image, a pixel X' at the same spa- 
tial position as the spatial position of the pixel X in the 
(M-1 yth image is deviated by a detected move MV of 
a block unit including the pixel X', so that a pixel X" 
is obtained. This pixel X" is then used as a predicted 50 
value of the pixel X. In Fig. 6, the block is assumed 
to have a size of 3 x 3. 

When a signal is an interlace signal, there are 
many alternative cases considered for predicting 
compensation of a move of an image. For example, 55 
either a frame or a field is used for the image, and a 
frame is used for a reference image and a field is used 
for an input image, etc. The basic principle is as ex- 
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plained with reference to Fig. 6 above. As one of the 
examples of the above method for predicting move 
compensation, there is Recommendation 723, 
Transmission of component-coded digital television 
signals for contribution-quality at the third hierarchi- 
cal level of CCITT Recommendation G.702" which 
was standardized by the CMTT (Commission Mixte 
CCIR/CCITT pour les Transmissions Televisuelles et 
Sonores 3). In this recommendation, a prediction of 
move compensation between frames and a prediction 
of move compensation between fields are suitably 
changed over between the two cases. As described 
above, according to the conventional method for pre- 
dicting move compensation of an image, a prediction 
is made by compensating a move of the image based 
on a detected move of the image. Therefore, the con- 
ventional predicting method can predict move com- 
pensation with a high level of precision even if an im- 
age is a dynamic image including a move. 

The above-described conventional method for 
predicting move compensation, however, has prob- 
lems that it is not possible to accurately predict move 
compensation and that, even if it is possible to make 
a correct prediction of move compensation, the im- 
age density of an image to be referred to becomes the 
image density of a reference image, which makes it 
impossible to make prediction at a higher level of pre- 
cision. 

For example, in the case of predicting move com- 
pensation by using an interlace signal as a frame and 
generating a block from this frame, frames are com- 
bined together to compensate a move of an image by 
disregarding a difference in sampling positions, due 
to a time difference, between two fields within a 
frame. Accordingly, when correct sampling positions 
of the fields are considered, there is such a case that 
moves compensated in the first field and moves com- 
pensated in the second field do not coincide with 
each other. An example of this case is shown in Figs. 
7Ato 7C. Referring to Figs. 7A to 7C, an input signal 
is an interlace signal (Fig. 7A). Interlace signals are 
combined together in a frame to predict move com- 
pensation. When a vertical component of a move de- 
tected now is 1 . the first field of the M-th frame is pre- 
dicted from the second field of the (M-1 )-th frame and 
the second field of the M-th frame is predicted from 
the first field of the (M-1)-th frame, as shown in Fig. 
7B. Moves in the correct field positions are shown in 
Fig. 7C. As is clear from Fig. 7C, the moves for effect- 
ing compensation in the first field of the M-th frame 
do not coincide with the moves for effecting compen- 
sation in the second field of the M-th frame. As ex- 
plained above, when move compensation of an image 
is made by handling an interlace image as a frame, 
the moves for effecting compensation are different 
between the first field and the second field. In a vec- 
tor in which this phenomenon occurs, there is a prob- 
lem that the precision level of prediction is deteriorat- 
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ed. 

Next, consider a case of predicting move com- 
pensation of an image as an image of a correct pos- 
ition without disregarding a time difference of sam- 
pling between images as described above. As exam- s 
pies of this case, there are a case where move com- 
pensation is predicted for an interlace signal by gen- 
erating a block from a field, and a case where move 
compensation is predicted for a non inter lace signal. 
In the above cases, move compensation is predicted 10 
by using an image at a position of a correct time. 
Therefore, there arises no such problem which occurs 
in the case of predicting move compensation by gen- 
erating a block from a frame of the interlace signal as 
described above. However, in this case, move com- is 
pensation is predicted from one piece of reference im- 
age and the pixel density of an image to be referred 
to becomes the pixel density of the reference image, 
so that there is a limit to carrying out a prediction of 
move compensation at a higher level of precision. Fig. 20 
8 shows a case of predicting move compensation by 
generating a block from a field for an input of an in- 
terlace signal. In this case, prediction of move com- 
pensation is carried out by using a field image as a 
reference image. Therefore, when a move vector is O 25 
there is no sampling point at a position necessary for 
making a prediction on the reference image and, ac- 
cordingly, a pixel value, or a predicted value, must be 
calculated by an interpolation within the field, as 
shown in Fig. 8, for example. As compared with the 30 
case for compensating a move by generating a block 
based on a pixel value within a frame, the case for 
compensating a move based on the field has a pixel 
density in a vertical direction which is half of the pixel 
density in the case of compensating a move based on 35 
a frame. Thus, there is a limit to carrying out a pre- 
diction of move compensation at a high level of pre- 
cision when move compensation is carried out based 
on a field. This problem also arises when move com- 
pensation is carried out by using a non-interlace sig- 40 
nal as an input In both cases, the pixel density of the 
image to be referred to becomes the pixel density of 
the reference image, and there is a limit to carrying 
out a prediction of move compensation at a higher lev- 
el of precision. 45 

SUMMARY OF THE INVENTION 

With a view to eliminating the above-described 
problems of the prior-art technique, it is an object of so 
the present invention to provide a method for predict- 
ing move compensation with a very high level of pre- 
cision by utilizing a plurality of pieces of reference im- 
ages. 

In order to achieve the above-described object of 55 
the present invention, the method of the present in- 
vention predicts move compensation of an input im- 
age based on a move vector of a reference image 
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from an original position of the reference image to a 
position of the reference image sampled at a first set 
time, and the method includes a unit for calculating a 
move vector of an input image by calculating a move 
at a second set time of a block unit which is a part of 
the input image and also consists of a plurality of pix- 
els and a unit for calculating a move vector of the ref- 
erence image by calculating a move at the first set 
time of a block unit which is a part of the reference im- 
age and also consists of a plurality of pixels, to there- 
by calculate move compensation of the input image 
at a desired set time both from the move vector of the 
input image and from the move vector of the refer- 
ence image. 

Also, the method of the present invention pre- 
dicts move compensation of a plurality of pieces of in- 
put images based on a move vector of a reference im- 
age from an original position of the reference image 
to a position of the reference image sampled at a first 
set time, and the method includes a unit for calculat- 
ing move vectors of input images by calculating 
moves at a second set time of block units, each block 
forming a part of each input image and also consist- 
ing of a plurality of pixels, and a unit for calculating a 
move vector of the reference image by calculating a 
move at the first set time of a block unit which is a part 
of the reference image and also consists of a plurality 
of pixels, regarding these move vectors of the input 
images to be the same, to thereby calculate move 
compensation of the input images at a desired set 
time both from the move vectors of the input images 
and the move vector of the reference image. 

Therefore, according to the present invention, a 
time position of a reference image is compensated by 
using a certain move vector depending on the need 
so that a plurality of pieces of reference images sam- 
pled at different times according to the move of a 
block unit, including at least one pixel, which is detect- 
ed at a certain time interval, become images of the 
input image at the above time intervals from the pos- 
ition of the input image. Thus, it is possible to obtain 
a plurality of pieces of images at positions of the 
above-described time intervals from the position of 
the input image. By combining these images togeth- 
er, it is possible to obtain a reference image of high 
pixel density. Based on this reference image of high 
pixel density, a pixel value at a position compensated 
by the detected move portion is calculated and this 
is used as a predicted value. Accordingly, it is possible 
to predict move compensation at a very high level of 
precision. 

Further, according to the present invention, a 
vector for carrying out compensation of a time posi- 
tion of the reference image can be calculated from a 
move of the image detected at a certain time interval, 
so that it is not necessary to detect again the move 
vector for correcting the time, and move compensa- 
tion at a high level of precision can be ensured. 
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Further, by using an interlace signal as an input 
signal and using two fields in a certain frame for a ref- 
erence image, it becomes possible to suitably apply 
the above method for predicting move compensation 
to a frame image, thus ensuring a prediction at a high 
precision levei of move compensation based on a 
frame. 

* Further, since the same value is used for a block 
of each input image, of which whole or part of spatial 
position of each block is superposed, among blocks 
of a plurality of pieces of input images, as a move de- 
tected at a certain time interval in a block unit includ- 
ing at least one pixel, it is not necessary to carry out 
move detection by a plurality of times for many blocks 
of the plurality of input images, thus ensuring a pre- 
diction of move compensation at a high level of pre- 
cision. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a diagram for explaining the first embodi- 
ment of the present invention; 
Figs. 2A and 2B are diagrams for explaining the 
second embodiment of the present invention; 
Fig. 3 is a diagram for explaining a block for pre- 
dicting move compensation using a frame as a 
base; 

Figs. 4A and 4B are diagrams for explaining the 
third embodiment of the present invention; 
Fig. 5 is a diagram for explaining the fourth em- 
bodiment of the present invention; 
Fig. 6 is a conceptional diagram for showing the 
conventional method for predicting move com- 
pensation; 

Fig. 7A to Fig. 7C are diagrams for explaining 
problems of the conventional method for predict- 
ing move compensation between frames; and 
Fig. 8 is a diagram for explaining the conventional 
method for predicting move compensation be- 
tween fields. 

DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

Fig. 1 is a diagram for explaining a first embodi- 
ment of the present invention. Fig. 1 assumes the pre- 
diction of move compensation based on an interlace 
signal as an input signal so that a block is generated 
from an image within a field and a field image is used 
as a base. In this case, the input image is in the M- 
th field and a reference image is in both the (M-1)-th 
field and the (M-2)-th field. Now, assume that a move 
vector (MV) for predicting move compensation of a 
certain block is to be detected in a two-field instance, 
that is, between the M-th field and the (M-2)-th field. 
To simplify the explanation, of the detected moves, 
only the move in the vertical direction will be consid- 
ered, and a pixel value is expressed as a(x, y). In this 



case, x represents a field number and y represents a 
line number. Line numbers are placed in the order of 

1, 2 starting from the bottom in a line interval of 

the frame. A position of each pixel in a vertical direc- 
5 tion is expressed always in the unit of a frame line. 

Now, consider a case for obtaining a predicted 
value of (M, 1). When a vertical component of a de- 
tected MV is 1 , a predicted value of move compensa- 
tion of a (M, 1) becomes a pixel value at a position of 
10 (M-2, 2). Next, a time position is corrected so that the 
position of the reference image in the (M-1)-th field 
becomes an image at the position of the (M-2)-th 
field. A vector for correcting this time position is set 
as MV adj. In calculating the MV adj from the MV, the 
15 following relationship can be easily drawn when it is 
assumed, for example, that moves from the (M-2)-th 
field to the M-th field are constant: 
MV adj = - MV/2 
Therefore, when the vertical component of the MV is 
20 1, the vertical component of the MV adj becomes - 
0.5. When this is applied to the positional correction 
for correcting the positions of the (M-1)-th field to the 
positions of the (M-2)-th field, a (M-1 , 2) in the (M-1 )- 
th field is corrected to the position of (M-2, 2.5) in the 
25 (M-2)-th field, as shown in Fig. 1. After the above op- 
eration, the position of (M-2, 2) which is the predicted 
value of move compensation of the a (M, 1) is ob- 
tained from pixel values of the (M-2)-th field and the 
(M-1H n f' eld which is the result of a time positional 
30 correction. In this case, when a necessary pixel value 
is to be obtained by a weighted average, which is in- 
verse proportional to a distance, from near-by pixel 
values, for example, the pixel value at the position of 
the (M-2, 2), that is the predicted value of move com- 
35 pensation of the a (M, 1 ), is obtained by the following 
expression: 

a(M-2, 1)/3 + 2 * a(M-1 * 2)/3 
Although the above explains a prediction of move 
compensation taking account of only vertical compo- 
40 nents, a similar operation is also applied to the case 
for predicting move compensation for an image hav- 
ing both vertical and horizontal components. 

As described above, according to the first em- 
bodiment of the present invention, a time position of 
45 a reference image is corrected by using a move vector 
as required so that a plurality of pieces of reference 
images sampled at different times become an image 
at a time which is positioned with a vertain time inter- 
val from the position of the input image, according to 
so detected moves at the above time interval of a block 
unit including at least one pixel. Therefore, it is possi- 
ble to obtain a plurality of pieces of images at posi- 
tions which are separated from the input image by the 
above time intervals. A reference image with high pix- 
55 el density is obtained by combining these pieces of 
images, and a pixel value at a position which compen- 
sates the detected move is calculated by using the 
reference image of high pixel density, and the calcu- 
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lated pixel value is used as a predicted value. As a re- 
sult, there is an effect that it is possible to carry out 
a prediction of move compensation of an image at a 
very high precision level. 

The assumptions used in the above description 5 
of the first embodiment are plexible and the following 
alternative assumptions can also be accepted. In- 
stead of assuming two images for a reference image, 
any plurality of number of pieces of images can also 
be used. Instead of assuming the positions of the 10 
plurality of reference images as the previous image 
and the previous image, these positions can also be 
set flexible. Instead of assuming a constant move of 
an image for calculating the MV adj from the MV, any 
assumption of a move can also be used according to 15 
a certain rule for calculating the MV adj from the MV. 
Instead of using a weighted average which is inverse 
proportional to a distance from near-by pixel values 
to obtain a pixel value at a necessary position, a coef- 
ficient of a low-pass filter, for example, can also be 20 
used to obtain the pixel value at a necessary position. 
Instead of using an interpolation for obtaining a nec- 
essary pixel value, an extrapolation, for example, can 
also be used to obtain the necessary pixel value. 

Further, although the vector M adj for correcting 25 
positions of a plurality of pieces of reference images 
is calculated from a move vector MV which is detected 
in a block unit in the above-described first embodi- 
ment of the present invention, the MV can also be de- 
tected independently between the (M-1)-th field and 30 
the (M-2)-th field. In this case, by an independent de- 
tection of the MV, the time correction can be effected 
based on a more accurate move of the image. Thus, 
this method has an effect that a prediction of move 
compensation of an image at a higher level of preci- 35 
sion can be ensured. 

Further, although an interlace signal is used as 
an input signal and a field image is assumed as each 
image in the above-described first embodiment of the 
present invention, a non-interlace image can also be 40 
used, with an effect that a prediction of move com- 
pensation of an image can be ensured at a higher lev- 
el of precision, for the same reason as explained 
above. 

Next, a second embodiment of the present inven- 45 
tion for predicting move compensation of an image by 
using an interlace signal as an input signal and using 
a frame as an input, will be explained. Figs. 2Aand 2B 
are diagrams for explaining the second embodiment 
of the present invention. Referring to Figs. 2Aand 2B, so 
a reference image is in two fields of the previous 
frame, that is, the (M-1)-th field and the (M-2)-th 
field, and an input image is in two fields of the current 
frame, that is, the M-th field and the (M+1)-th field. 
In Figs. 2Aand 2B, it is assumed that a move vector 55 
for predicting move compensation of a certain block 
is obtained within an input image and a reference 
frame and between fields of the same phase as that 



of the M-th field, for each two fields of the current 
frame. The move vector for predicting move compen- 
sation of the M-th field is expressed as MV(M) and 
the move vector for the (M+1)-th field is expressed as 
MV(M+1). A pixel value of each pixel position is ex- 
pressed in the same manner as that of the first em- 
bodiment. To simplify the explanation of Figs. 2A and 
2B, of the detected moves, only the move in the vert- 
ical direction will be considered. 

In Figs. 2A and 2B, a prediction of a pixel within 
the M-th field is carried out by using images in the (M- 
1 >-th field and the (M-2)-th field, in exactly the same 
operation as that of the first embodiment of the pres- 
ent invention. For example, when th vertical compo- 
nent of the MV(M) is 1.5, the predicted value of a(M, 
1) becomes the pixel value at the position of (M-2, 
2.5) according to the operation which is the same as 
that of the first embodiment, and this value is ob- 
tained by the following expression: 

a(M-2, 1)/7 + 6*a(M- 1,2)/7 
Similarly, in the same manner as that of the predic- 
tion of a pixel within the M-th field, a pixel within the 
(M+1)-th field is predicted from the two fields of the 
reference frame, that is, the (M-1)-th and (M-2)-th 
fields. The method of prediction in this case is the 
same as the method for predicting a pixel within the 
M-th field, except that the (M-2)-th field needs to be 
corrected to the position of the (M-1 )-th field. A vector 
for correcting this time position is set as MV adj 
(M+1). In calculating the MV adj (M+1) from the 
MV(M+1), when the moves from the (M-2)-th field to 
the (M+1)-th field, for example, are constant, the fol- 
lowing relationship can be obtained easily: 
MV adj (M+1) = MV(M + 1)/2 
Therefore, when the vertical component of the 
MV(M+1) is 1, the vertical component of the MV adj 
(M+1) becomes 0.5. As shown in Figs. 2A and 2B, 
when the (M-2)-th field is positionally corrected to the 
position of the (M-1)-th field, the a(M-2, 3) is position- 
ally corrected to the position of th (M-1, 2.5). After the 
above operation, the position of the (M-1 , 3) which is 
a predicted value of the a(M+1,2) is obtained from the 
pixel value of the (M-1 )-th field and the pixel value of 
the (M-2)-th field of which time position has been cor- 
rected. When a necessary pixel value is to be ob- 
tained by a weighted average, inversely proportional 
to a distance, from near-by pixel values, for example, 
a predicted value at the position of the (M-1, 3), that 
is, a predicted value of move compensation of the 
a(M+1, 2), is obtained by the following expression: 
a(M-1,4)/3 + 2*a(M-2, 3)/3 

-Although the above explains the prediction of 
move compensation of an image for only the vertical 
component, a similar operation is also applied to the 
case for predicting move compensation of an image 
having both vertical and horizontal components. 

As described above, according to the second em- 
bodiment of the present invention, the above- 
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described prediction of move compensation can be 
applied to a frame image, by using an interface signal 
as an input signal and by setting a reference image in 
two fields of a certain frame. As a result, there is an 
effect that it is possible to predict move compensation 5 
of an image at a high level of precision by using a 
frame as a base. 

The above-described second embodiment also 
has a flexibility in the assumptions used, in the same 
mannerasthatofthefirstembodiment Forexample, 10 
the number of reference frames, the positions of the 
reference frames, the assumptions for obtaining the 
MV adj (M) or MV adj (M+1) from either the MV(M) or 
the MV(M+1), the calculation method for obtaining a 
pixel value at a necessary position, and either inter- 15 
polation or extrapolation, can also be selected freely. 
Further, although it is assumed in the present em- 
bodiment that a move vector for predicting move com- 
pensation can be obtained within the input image and 
reference frame and between fields of the same 20 
phase as that of the input image, it is also possible to 
obtain the move vector between fields of opposite 
phases, in the same manner of operation, with the 
similar effect. Further, when a position correction 
vector is obtained independent of a detection move 25 
vector, in the same manner as that of the first embodi- 
ment, there is an effect that it is possible to predict 
move compensation at a higher level of precision. 

Next, as a third embodiment of the present inven- 
tion, another method for predicting move compensa- 30 
tion for an interlace input signal based on a frame unit 
will be explained. Fig. 3 and Figs. 4Aand 4B are dia- 
grams for explaining the third embodiment of the 
present invention. Referring to Fig. 3, a reference im- 
age is in the (N-1)-th frame, that is, the (M-2) and (M- 35 
1 ) fields, and an input image is in the N-th frame, that 
is, the M-th and.(M+1)-th fields. Now assume that a 
block for carrying out move compensation is being 
generated from the frame. Assume that a move vector 
MV is to be obtained in the block unit generated from 40 
the pixels of the N-th frame, from the (N-1)-th frame. 
The status of the block in this case is shown in Fig. 
3. In terms of the method for predicting move com- 
pensation based on a field, the following method can 
be considered. The reference image is in the two 45 
fields of the (N-1)-th frame and the input image is in 
the two fields of the N-th frame. The detecting inter- 
val of the MV is the two-field interval. However, the 
pixels included in the above block have the same 
move vector MV for both the pixels in the M-th field so 
and the pixels in the (M+1)-th field. 

In other words, in the case of the third embodi- 
ment, move vectors to be used for pixels within a 
block generated from th above frame take the same 
value regardless of whether the pixels belong to the 55 
M-th field or the (M+1)-th field. The other operations 
become the same as those of the second embodi- 
ment. Figs. 4Aand 4B show the case that the vertical 



component of the MV is 1. Although the above ex- 
plains the case of predicting move compensation of 
an image for only the vertical component, a similar 
operation is also carried out for the case of predicting 
move vector of an image having both vertical and hor- 
izontal components. 

As described above, according to the third em- 
bodiment of the present invention, the same move 
vector is used for pixels in the two input fields posi- 
tioned within a predetermined spacial area such as a 
block generated by the frame. Accordingly, it is not 
necessary to detect move vectors for each field ac- 
cording to this method, which also has an effect that 
it is possible to predict move compensation at a high 
level of precision. 

The above-described third embodiment also has 
a f lexibily in the assumptions used, similar to t he case 
of the second embodiment. For example, th number 
of reference frames, the positions of the reference 
frames, the assumption for obtaining the MV adj from 
the MV, the calculation method for obtaining a pixel 
value at a necessary position, and whether interpo- 
lation or extrapolation is to be used, can all be select- 
ed freely. Although description has been made of the 
case for predicting move compensation based on a 
frame as a unit in the present embodiment, it is need- 
less to mention that there is no change in the effect 
of prediction if the prediction is carried out based on 
a field as shown in the first embodiment or if the pre- 
diction is carried out based on a noninterlace image. 
Further, when a block to be used for having the same 
value of the move vector is selected from among 
blocks of a plurality of pieces of input images in such 
a way that the block selected is a block of each input 
image of which part or whole of the spatial position 
superposes with those of the other blocks selected, 
there is no change in the effect of prediction. Further, 
similar to the case of the second embodiment, by ob- 
taining a position correction vector independent of a 
detection move vector, there is an effect that it is pos- 
sible to predict move compensation at a higher level 
of precision. 

Fig. 5 is a diagram for explaining a fourth embodi- 
ment of the present invention. The fourth embodi- 
ment takes the same assumptions as those of the 
first embodiment, and an interlace signal is used as 
an input signal, an input image is in the M-th field and 
a reference image is in both the (M-1)-th field and the 
(M-2)-th field. Assume in Fig. 5 that a move vector 
(MV) for predicting move compensation of a certain 
block is to be detected in a two-field interval, that is, 
between the M-th field and the (M-2)-th field. To sim- 
plify the explanation, of the detected moves, only the 
move in a vertical direction will be considered, and a 
pixel value at each pixel position is expressed in the 
same manner as that of Fig. 1. 

Now consider the case of obtaining a predicted 
value of a(M, 1). When it is assumed that the vertical 
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component of the detected MV is 3, the predicted val- 
ue of move compensation of the a(M, 1) becomes the 
pixel value at th position of (M-2, 4). First, this pixel 
value is obtained from the pixel value within the (Mr 
2}-th field. When the pixel value is to be obtained 
based on a weighted average, inversely proportional 
to a distance, from near-by pixel values, for example, 
th pixel value at the position of the (M-2, 4) is obtained 
by the following expression: 

a(M - 2, 3)/2 + a(M - 2, 5)/2 
Next, based on the above MV, a move of the input im- 
age from the (M-1)-th field to the M-th field is calcu- 
lated. The time difference between the M-th field and 
the (M-1)-th field is 1/2 of the time difference be- 
tween the M-th field and the (M-2)-th field. Accord- 
ingly, this move vector can be considered to be MV72. 
Since the vertical component of the MV is now 3, the 
vertical component of MV/2 becomes 1.5. According- 
ly, when a predicted value of move compensation of 
the a(M, 1) is obtained from the image in the (M-1)- 
th field, this becomes the pixel value at the position 
of (M-1, 2.5). This pixel value is obtained from a pixel 
value within the (M-1)-th field. When the pixel value 
is to be obtained by a weighted average, inversely 
proportional to a distance, from near-by pixel values, 
for example, the pixel value at the position of (M-1, 
2.5) can be obtained by the following expression: 

3 * a(M - 1, 2)/4 + a(M - 1, 4)/4 
Based on the two predicted values obtained above, a 
mean of the two predicted values is obtained and the 
result is used as the predicted value of the a(M, 1). 

Although the above explains the case for predict- 
ing move compensation of an image for only the vert- 
ical component, a similar operation is also carried out 
for the case of predicting move compensation of an 
image having both vertical and horizontal compo- 
nents. 

As described above, according to the fourth em- 
bodiment of the present invention, a move of an input 
image from a plurality of pieces of reference images 
sampled at different times according to a detected 
move at certain time intervals of a block unit including 
at least one pixel is calculated based on the above de- 
tected move, and a pixel value at a position which has 
been compensated by the calculated move portion 
for each reference image is calculated, so that it is 
possible to obtain a plurality of predicted values of 
move compensation from the plurality of pieces of ref- 
erence images. Since a predicted value of the input 
image is calculated from the plurality of predicted val- 
ues, a noise can be eliminated if a noise is included 
in the predicted values, thus ensuring a prediction at 
a high precision level, of move compensation. 

In the manner similar to the case of the first em- 
bodiment, it is also possible in the fourth embodiment 
to freely select the number of pieces of reference im- 
ages, the positions of the reference images, the cal- 
culation method for obtaining a pixel value at a nec- 



essary position within each reference image, and 
either interpolation or extrapolation. For calculating 
predicted values from a plurality of pixel values ob- 
tained from the respective reference images, there 
5 are other alternative methods than a simple averag- 
ing method such as a weighted average method and 
a method for calculating by using a coefficient of a 
low-pass filter. Although description has been made 
of the case for predicting move compensation based 
10 on a field of an interlace signed in the present em- 
bodiment, it is needless to mention that the effect of 
the prediction does not change if a frame is used as 
a base or a non interlace image is used as a base as 
shown in the second and third embodiments respec- 
ts lively. 

According to the present invention, as is clear 
from the above-described embodiments, a time pos- 
ition of a reference image is corrected by using a 
move vector as required so that a plurality of pieces 
20 of reference images sampled at different times ac- 
cording to a detected move at certain time intervals 
of a block unit including at least one pixel become im- 
ages at times separated from the input image by the 



above time intervals, so that it is possible to obtain a • <t 

25 plurality of pieces of images at positions separated by ■ 
the above time intervals from the input image. By 
combining the plurality of pieces of images together, 
a reference image of high pixel density can be ob- 
tained and a pixel value at a position which has been 
30 compensated by the detected move is calculated by - 5 

using the reference image of high pixel density, so - 
that the calculated pixel value is used as a predicted 



value. Thus, there is an effect that it is possible to pre- 
dict move compensation of an image at a very high 

35 level of precision. 

Further, according to the present invention, a 
vector for correcting a time position of the above ref- 
erence image can be calculated based on a move de- 
tected at a certain time interval, which does not re- 

40 quire a detection again of a move vector for correcting 
the time position, so that this has an effect that move 
compensation at a high precision level can be en- 
sured. Further, since an interlace signal can be used 
as an input signal and a reference image can be in two 

45 fields of a certain frame, t he above prediction of move 
compensation can be applied to a frame image, thus 
ensuring a prediction, at a high precision level, of 
move compensation based on a frame. 

Further, since the same value can be used for a 

50 block of each input image among blocks of a plurality 
of pieces of input images, each block having its whole 
or part of spatial position superposed with that of the 
other blocks, as a move detected at a certain time in- 
terval of a block unit including at least one pixel, it is 

55 not necessary to carry out a plurality of detections of 
moves of many block in a plurality of input images so 
that there is an effect that a prediction of move com- 
pensation at a high precision level can be ensured. 

7 
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Claims 

1. A method for predicting move compensation for 
predicting move compensation of an input image 
based on a move vector of said input image from 5 
said input image to a reference image which has 
been sampled at a first set time, said method in- 
cluding means for calculating a move vector of 
said input image based on a move, at a second 

set time, of a block unit which is a part of said in- 10 
put image and consists of a plurality of pixels, and 
means for calculating a move vector of said ref- 
erence image based on a move, at said first set 
time, of a block unit which is a part of said refer- 
ence image and consists of a plurality of pixels, 15 
to thereby calculate move compensation of said 
input image at a desired set time both from said 
move vector of said input image and from said 
move vector of said reference image. 

20 

2. A method for predicting move compensation ac- 
cording to Claim 1 , wherein said means for calcu- 
lating a move vector of said reference image sets 
at least two sampling times for sampling said ref- 
erence image and calculates a move vector of 25 
said input image based on move data of said ref- 
erence image in block units at said sampling 
times. 

3. A method for predicting move compensation for 30 
predicting move compensation of an input image 
based on a move vector of said input image from 

said input image to a reference image which has 
been sampled at a first set time, said method in- 
cluding means for calculating a move vector of 35 
said input image based on a move, at a second 
set time, of a block unit which is a part of said in- 
put image and consists of a plurality of pixels, and 
means for calculating a move vector of said ref- 
erence image at said first set time by using said 40 
move vector of said input image, to thereby cal- 
culate move compensation of said input image at 
a desired set time both from said move vector of 
said input image and from said move vector of 
said reference image. 45 

4. A method for predicting move compensation ac- 
cording to Claim 1 , wherein said means for calcu- 
lating a move vector of said reference image sets 

at least two sampling times for sampling said ref- so 
erence image and calculates a move vector of 
said input image based on move data of said ref- 
erence image in block units at said sampling 
times. 

55 

5. A method for predicting move compensation for 
predicting move compensation of a plurality of 
pieces of input images based on a move vector of 



said plurality of input images from said input im- 
ages to a reference image which has been sam- 
pled at a first set time, said method including 
means for calculating move vectors of said plur- 
ality of input images based on a move, at a sec- 
ond set time, of block units, each block being a 
part of each of said plurality of input images and 
consisting of a plurality of pixels, and means for 
calculating a move vector of said reference image 
based on a move, at said first set time, of a block 
unit which is a part of said reference image and 
consists of a plurality of pixels, said move vectors 
of said plurality of input images being assumed to 
be the same, to thereby calculate move compen- 
sation of said input image at a desired time both 
from said move vector of said input images and 
from said move vector of said reference image. 

6. A method for predicting move compensation ac- 
cording to Claim 5, wherein said means for calcu- 
lating a move vector of said reference image sets 
at least two sampling times for sampling said ref- 
erence image and calculates a move vector of 
said input image based on move data of said ref- 
erence image in block units at said sampling 
times. 

7. A method for predicting move compensation for 
predicting move compensation of a plurality of 
pieces of input images based on a move vector of 
said plurality of input images from said input im- 
ages to a reference image which has been sam- 
pled at a first set time, said method including 
means for calculating move vectors of said plur- 
ality of input images based on a move, at a sec- 
ond set time, of block units, each block being a 
part of each of said plurality of input images and 
consisting of a plurality of pixels, and means for 
calculating a move vector of said reference image 
at said first set time by using said move vectors 
of said plurality of input images, said move vec- 
tors of said plurality of input images being as- 
sumed to be the same, to thereby calculate move 
compensation of said input image at a desired 
time both from said move vector of said input im- 
ages and from said move vector of said reference 
image. 

8. A method for predicting move compensation ac- 
cording to Claim 7, wherein said means for calcu- 
lating a move vector of said reference image sets 
at least two sampling times for sampling said ref- 
erence image and calculates a move vector of 
said input image based on move data of said ref- 
erence image in block units at said sampling 
times. 
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